Nested Dichotomies with probability sets for multi-class classification
نویسندگان
چکیده
Binary decomposition techniques transform a multi-class problem into several simpler binary problems. In such techniques, a classical issue is to ensure the consistency between the binary assessments of conditional probabilities. Nested dichotomies, which consider tree-shaped decomposition, do not suffer from this issue. Yet, a wrong probability estimate in the tree can strongly biase the results and provide wrong predictions. To overcome this issue, we consider in this paper imprecise nested dichotomies, in which binary probabilities become imprecise. We show in experiments that the approach has many advantages: it provides cautious inferences when only little information is available, and allows to make efficient computations with imprecise probabilities even when considering generic cost functions.
منابع مشابه
Ensembles of Balanced Nested Dichotomies for Multi-class Problems
A system of nested dichotomies is a hierarchical decomposition of a multi-class problem with c classes into c − 1 two-class problems and can be represented as a tree structure. Ensembles of randomlygenerated nested dichotomies have proven to be an effective approach to multi-class learning problems [1]. However, sampling trees by giving each tree equal probability means that the depth of a tree...
متن کاملBuilding Ensembles of Adaptive Nested Dichotomies with Random-Pair Selection
A system of nested dichotomies is a method of decomposing a multi-class problem into a collection of binary problems. Such a system recursively splits the set of classes into two subsets, and trains a binary classifier to distinguish between each subset. Even though ensembles of nested dichotomies with random structure have been shown to perform well in practice, using a more sophisticated clas...
متن کاملMulti-class from Binary - Divide to conquer
Several researchers have proposed effective approaches for binary classification in the last years. We can easily extend some of those techniques to multi-class. Notwithstanding, some other powerful classifiers (e.g., SVMs) are hard to extend to multi-class. In such cases, the usual approach is to reduce the multi-class problem complexity into simpler binary classification problems (divide-and-...
متن کاملA Fast Approach to Improve Classification Performance of ECOC Classification Systems
Error correcting output coding is a well known technique to decompose a multi-class classification problem into a group of two-class problems which can be faced by using a combination of binary classifiers. Each of them is trained on a different dichotomy of the classes. The way the set of classes is mapped on this set of dichotomies may essentially influence the obtained performance. In this p...
متن کاملStrategic complementarities and nested potential games ∗ Hiroshi Uno
This paper shows that every finite game of weak strategic complementarities is a nested pseudo-potential game if the action set of one player is multi-dimensional and the action sets of the others are one-dimensional; the implication does not hold, however, if the action sets of more than two players are multi-dimensional. Moreover, the paper proposes a new class of games of nested strategic co...
متن کامل